-
Notifications
You must be signed in to change notification settings - Fork 195
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEA] Masked NN for connect_components #1445
[FEA] Masked NN for connect_components #1445
Conversation
…to update-connected-components
…update-connected-components
…update-connected-components
…update-connected-components
…update-connected-components
…update-connected-components
…update-connected-components
cpp/include/raft/sparse/neighbors/detail/connect_components.cuh
Outdated
Show resolved
Hide resolved
…update-connected-components
…update-connected-components
…update-connected-components
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Took another pass. I think it's almost there. Mostly just a couple minor things but would still like to see more assertion cases for scatter.cu
tests.
@@ -59,21 +59,41 @@ value_idx get_n_components(value_idx* colors, size_t n_rows, cudaStream_t stream | |||
* @param[in] orig_colors array containing component number for each row of X | |||
* @param[in] n_rows number of rows in X | |||
* @param[in] n_cols number of cols in X | |||
* @param[in] reduction_op | |||
* @param[in] metric | |||
* @param[in] reduction_op reduction operation for computing nearest neighbors. The reduction |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we also rename this file to cross_component_nn
?
cpp/test/matrix/scatter.cu
Outdated
INSTANTIATE_TEST_CASE_P(ScatterTests, test_name, ::testing::ValuesIn(test_inputs)) | ||
|
||
const std::vector<ScatterInputs<int>> inputs_i32 = | ||
raft::util::itertools::product<ScatterInputs<int>>({2000}, {6, 31, 129}, {2, 3, 6}, {1234ULL}); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Still need more cases here (e.g. different parameter settings).
…update-connected-components
…ng-jain/raft into update-connected-components
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great work, @tarang-jain! LGTM, but we need to make sure we synchronize the merge with cuml.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the hard work! Just a single comment related to RAFT_EXPLICIT_INSTANTIATE.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
…update-connected-components
…ng-jain/raft into update-connected-components
/merge |
Make HDBSCAN MST reduction operation compatible with [#1445](rapidsai/raft#1445) raft PR. This PR updates the Mutual Reachability reduction op in HDBSCAN in the following ways: 1. Colors information is no longer needed in the reduction op because the new `mst` implementation in raft ensures that distances between points of the same color are not computed. 2. Adds gather and scatter functions to rearrange the core distances within the reduction op so that they are aligned with the sort-plan wherein rows in the input matrix and core distances are rearranged so that the training data points are sorted by color. Closes #5456 Authors: - Tarang Jain (https://github.com/tarang-jain) - Corey J. Nolet (https://github.com/cjnolet) Approvers: - Divye Gala (https://github.com/divyegala) - Corey J. Nolet (https://github.com/cjnolet) URL: #5386
Replace fused L2 Nearest Neighbors in
connect_components
with masked NN.Closes #743
Closes #1569